PROPAGATION THROUGH TRAPPED SETS AND SEMICLASSICAL 

RESOLVENT ESTIMATES 
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Abstract. Motivated by the study of resolvent estimates in the presence of trapping, we 
prove a semiclassical propagation theorem in a neighborhood of a compact invariant subset 
of the bicharacteristic flow which is isolated in a suitable sense. Examples include a global 
trapped set and a single isolated periodic trajectory. This is applied to obtain microlocal 
resolvent estimates with no loss compared to the nontrapping setting. 



1. Introduction 

In this paper we study the following phenomenon: losses in high energy, i.e. semiclassical, 
resolvent estimates caused by trapping are removed if one truncates the resolvent (microlo- 
cally) away from the trapped set. Such results go back to work of Burq |Bur02] and Cardoso 
and Vodev [Ca Vo02] . Our result is based on a microlocal propagation estimate and is able 
to distinguish between different components of the trapped set. As an illustration, consider 
the following example: 

Let (X, g) be the catenoid or the hyperbolic cylinder, i.e. the quotient of the hyperbolic 
upper half plane by (z \-> 2z). Let P = h 2 A g - 1. Let R h (X) = (P - A) -1 . We are 
interested in behavior of this resolvent family when Re A = 0, Im A — > + (this corresponds 
to energy 1/h 2 for the non-semiclassical A g ). It is well known that the limiting behavior of 
the resolvent is closely connected to dynamics of the geodesic flow on the energy surface, i.e. 
on the unit cosphere bundle. In this case the trapped, or nonwandering, set consists of two 
periodic orbits whose projections to X are the same, see Figure [Tj Denote these two orbits 
by T 1 and T 2 , and denote by T± the set of p G S*X such that the lifted geodesic through p 
tends to r 1 as t — > =Foo, and define similarly. Let u = Rf l (X)f with A as above. If / is 
(9(1), then u is OQ log h\ h~ l ) by a result of Christianson |Chr07| IChr08j . A consequence of 
our main result is that if in addition / vanishes microlocally near T 1 but not near T 2 , then u 
is actually (9(/i _1 ) on T*X \ (T 1 U r+). If we assume that / vanishes microlocally near T 2 as 
well, then a result of Cardoso and Vodev |CaVo02j (following earlier work of Burq [Bur02j) 
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Figure 1. The two closed orbits T 1 and T 2 are obtained by lifting the geodesic 
at the neck of the catenoid or hyperbolic cylinder to S*X. The sets r±, which 
by definition contain the T- 7 , each consist of the infinitely many trajectories 
spiraling towards P as t — » =Foo. If u = Rh(X)f and / is Oil) then u is 
0{\ log h\ h^ 1 ) globally by |Chr07| IChr 08j . If / vanishes microlocally near 
T 1 U T 2 then u is actually C^" 1 ) off of T 1 U T 2 by |CaVo02j . If / vanishes 
microlocally only near T 1 , we find that u is actually off of T 1 U T 2 + . 

implies that u is 0{h~ l ) on T*X \ (T l U T 2 ). The novelty in this example is that we keep 
this improvement on T l + even when / is nontrivial on V 2 . 

More generally, let (X, g) be a complete Riemannian manifold, P = h 2 A g + V— 1 a semiclassi- 
cal Schrodinger operator, V G C°°(X] E) bounded, h G (0, 1). We say that a bicharacteristic 
(by which we always mean a bicharacteristic in S = p~ l {I) for some / C R compact) is 
backward nontrapped if the flowout of any point on it is disjoint from any compact set for 
sufficiently negative time (this definition is generalized in Suppose the resolvent family 
-R/i(A) for A G D C {Re A G J, ImA > — 0(h°°)}, where D is any subset, is polynomially 
bounded in h over compact subsets of T*X. This means that for any a, b G C^°(T*X) there 
is k G N such that || Op(a)Rh(X) Op(fe) ||l2^ L 2 < h~ k . Suppose further that Rh(\) is semi- 
classically outgoing with a loss of /i -1 at backward nontrapped points in the following sense: 
if u = Rh(X)f and p lies on a backward nontrapped bicharacteristic, and if / is 0(1) on the 
backward flowout of p, then u is Oih^ 1 ) at p. Suppose also that T, the trapped set (the set 
of precompact bicharacteristics), is compact. 

The following theorem generalizes the example at the beginning of the introduction: 

Theorem 1.1. Let (X,g), P and A be as in the above paragraph. Let a G C^°(T*X) have 
support disjoint from T, the trapped set. Let b G C^°(T*X) have support disjoint from all 
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connected components of T intersecting the closure of the backward bicharacteristic flowout 
of supp a. Then nontrapping estimates hold: 

|| Op(o)i2 h (A)Op(6)|| L2(XHi 2 W < Ch'\ (1.1) 



Here Op denotes the semiclassical quantization: see §|2} Since the projection of the cotangent 
bundle to the base 7i~: T*X — > X is a proper map when restricted to E, the condition that 
a, b G C^°(T*X) can be weakened using microlocal elliptic regularity. Indeed, we may 
replace that condition with the condition that a,b G C°°(T*X) are bounded together with 
all derivatives, and that 7rsuppa and 7rsupp6 are compact. 

Note that if X has suitable ends at infinity (for instance, asymptotically conic or hyperbolic), 
then the semiclassically outgoing assumption is satisfied (see §[6] below), we can use resolvent 
gluing to weaken the condition that ir supp a and n supp b are compact to a decay condition, 
leading to the following theorem. 

Theorem 1.2. Let (X,g) be a complete Riemannian manifold which is either asymptotically 
conic or asymptotically hyperbolic and even in the sense of ^ let A g be the nonnegative 
Laplace- Beltrami operator on X, let V G C^°(X), and fix E > 0. Suppose that for any 
Xo G C£°(X) there exist Co, k, ho > such that for any e > 0, h G (0, ho] we have 

\\Xo(h 2 A g + V-E- isY l Xo\\mx)^(x) < Coh~ k . (1.2) 

Let Ke C T*X be the set of trapped bicharacteristics at energy E, and suppose that a G 
C*o°(T*X) 2 S identically 1 near Ke- Then there exist C\,hi > such that for any e > 0, 
h G (0, hi] we have the following nontrapping estimate: 

||( r )-V2-* (1 _ p(a))(/ i 2 A g +y-£;-i £ )- 1 (l-Op(a))(r)- 1 / 2 - <5 |U 2w _ >I/2(x) < Ci/T 1 . (1.3) 



Here by bicharacteristics at energy E we mean integral curves in p~ x (E) of the Hamiltonian 
vector field H p of the Hamiltonian p = |£| 2 + V(x), and the trapped ones are those which 
remain in a compact set for all time. We use the notation r = r(z) = d g (z, z Q ), where d g is 
the distance function on X induced by g and z G X is fixed but arbitrary. 



Such results were first obtained by Burq |Bur02j . and were later refined by Cardoso and Vodev 
[CaVo02j . The improvement here is that to obtain the nontrapping bound the only condition 
on that cutoffs is that they vanish microlocally near Ke (while in those papers the cutoffs 
are functions on the base manifold, and are required to vanish on a large compact set whose 



size is not effectively controlled), but the assumption (1.2) is not needed in |Bur02|, ICaVo 02j . 



The assumption (1.2) is not true in general. Indeed, when there is elliptic (stable) trapping we 
have instead limsup^Q \\xo(h 2 A g + V — E — ie)~ 1 Xo\\L 2 (x)^L 2 (x) > e l ^ CK) (this has been well 
known for a long time - see e.g. |Ral71] for an example and |BBR10 



to the subject of semiclassical resolvent estimates). Nonetheless, (1.2) is satisfied for many 



hyperbolic trapped geometries, including those studied in |NoZw09 



for a recent introduction 



WuZwlOj . See |DaVal01 



Theorem 6.1] for (1.2) in the asymptotically hyperbolic case, and see |Dat09j and [WuZwlO, 
Corollary 1] for the asymptotically conic case. Bony and Petkov |BoPe06j prove (1.2) for 
a general "black box" perturbation of the Laplacian in IR n assuming only that there is a 
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resonance-free strip, and it is likely that this condition suffices for asymptotically conic or 
hyperbolic manifolds as well. It is an open problem to find the optimal general bound implied 
by a resonance free strip, or to find assumptions under which one has a polynomial bound 



(1.2) but no resonance free strip. 



We remark that, in the setting of |NoZw09] IWuZwlO] . (1.2) holds with Coh~ k replaced 
by C*o(log h~ 1 )h~ 1 , and so the improvement in our result is only of a factor of log(l//i). 
On the other hand, in [BBR10J, Bony, Burq and Ramond prove that for P a semiclassical 
Schrodinger operator on M. n , the presence of a single trapped trajectory implies that 

sup nxIP-Ai-xlla 1 ^, 

\e[-e,e] <^ n 

provided \ £ C^°(X) is 1 on the projection of the trapped set, so in this case (and probably 
in general) the improvement in Theorem |1.1| is of no less than a factor of log(l//i). In 
|ChWull] . Christianson and Wunsch give some examples of surfaces of revolution on which 
a resolvent estimate holds with a bound h~ k (but not Co(log h^ 1 )^ 1 ). 



We actually prove our main theorem in the following still more general setting. Suppose X 
is a manifold, P £ ty m,0 (X) a self adjoint, order m > 0, semiclassical pseudodifferential oper- 
ator on X, with principal symbol p. For Id compact and fixed, denote the characteristic 
set by £ = p _1 (J), and suppose that the projection to the base, n: £ — >• X, is proper (it 
is sufficient, for example, to have p classically elliptic). Suppose that T <s T*X is invariant 
under the bicharacteristic flow in E. Define the forward, resp. backward flowout r + , resp. 
r_, of r as the set of points p in the characteristic set, S, from which the backward, resp. 
forward bicharacteristic segments tend to T, i.e. for any neighborhood O of V there exists 
T > such that —t > T, resp. t >T, implies j(t) £ O, where 7 is the bicharacteristic with 
7(0) = p. Here we think of T as the trapped set or as part of the trapped set, hence points 
in T_, resp. r + are backward, resp. forward, trapped, explaining the notation. Suppose V, 
W are neighborhoods of V with V C W, W compact. Suppose also that 

If p £ W\T+, resp. p £ W\ T_, 

- (1-4) 

then the backward, resp. forward bicharacteristic from p intersects W \ V. 

The main result of the paper, from which the other results follow, is the following: 

Theorem 1.3. Suppose that u is a polynomially bounded family (in h) of distributions with 
(P — X)u — f, Re A £ / and ImA > —0(h°°). Suppose f is 0(1) in L 2 microlocally on 
W, WF h (f) n V = 0, and u is in C(/i _1 ) microlocally on W nT_\V, then u is C(/i _1 ) 
microlocally on W fl T + \ T. 



Note that there is no conclusion on u at T; typically it will be merely polynomially bounded. 
However, to obtain (9(/i _1 ) bounds for u on r + we only needed to assume (9(/i~ 1 ) bounds for 
u on T_ and nowhere else. Note also that by the propagation of singularities, if u is (9(/i _1 ) 
at one point on any bicharacteristic, then it is such on the whole forward bicharacteristic. If 
I ImA| = 0(h°°) then the same is true for backward bicharacteristics. 



In certain more complicated geometries it is possible to apply Theorem L3 with T a proper 
subset of T which is not a connected component, allowing both supp a and supp b to intersect 
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T. More specifically, when applying Theorem 1.3, W R f does not have to be a subset of T. 



This is because of the possibility of interesting dynamics within T, for example a trajectory 
which tends to different closed orbits as t — > ±00, and thus is trapped. In this case T could 



be one of the closed orbits. In £5.3 we give an (admittedly contrived) example of this. 



An interesting open question concerns the optimality of the condition ImA > —0(h°°) in 
Theorem |1.1| That some such condition is needed is suggested by the following result of 
Petkov and Stoyanov [PeSt09[ §4] for obstacle scattering on M. n with n odd. They show 
that if the cutoff resolvent continues analytically to { | Re A | < _E,ImA > — Ch log(l//i)}, 
then a polynomial bound for ||%(/i 2 A 9 — A) X X 1 1 m this range of A, even for x C^°(X) 
supported very far from the trapped set, implies the same bound for a general x £ Cq°(X), 
with possibly worse constant C. In other words, no improvement is possible for such a large 
range of A. In fact, we have been informed by Vesselin Petkov that the assumption that the 
cutoff resolvent continues analytically to a logarithmic region can be replaced by the same 
assumption on a strip, using the same method. 



The general idea of proving propagation estimates through trapped sets via commutator 
estimates is that near the trapped set T, where we cannot expect any improvement over a 
priori bounds, the commutator should vanish, which is in particular the case if the corn- 
mutant is microlocally near V a (possibly /i-dependent) multiple of the identity operator. 
Such a commutant, which is in addition decreasing along the Hamilton flow elsewhere on the 
characteristic set, at least apart from backward non-trapped bicharacteristics (where one has 
Oih -1 ) a priori bounds), can indeed be constructed, see In fact, under additional geomet- 
ric assumptions, namely a certain convexity (which also plays a role in |Bur02t ICaVo02| ) . one 
can use as commutants cutoff functions which are constant on the projection of the trapped 
set to the base manifold X; this is the special case we consider in £j3j 

This scheme has much in common with an aspect of A^-particle scattering. In order to 
prove asymptotic completeness for the short range A^-particle problem, it suffices to obtain 
improved weighted estimates in (z) 1//2 L 2 , where z is the variable on M. Nd (or K^ -1 ^), away 
from the radial set of the Hamilton vector field of the various subsystems, also called the 
propagation set of Sigal and Soffer |SiSo87] (the corresponding global weighted estimate 
is in (z) l l 2+£ L 2 , and the improvement though small is crucial in the argument). Since 
there cannot be an improvement at the radial set, the commutant used in the proof must 
commute microlocally with the Hamiltonian there. Similarly, in our case, there cannot be 
an improvement at the trapped set, and so our commutant must commute microlocally with 
P there. In the A^-particle setting, the weights (z) s do not commute with the Hamiltonians, 
unlike the weights h~ s in the semiclassical setting, so, to obtain a microlocally commuting 
commutant, one needs to work with s = 0, which in turn gives rise to weighted estimates only 
in the particular weighted space (z) l l 2 L 2 microlocally away from the radial set. See |SiSo87j 
and |DeGe99| for a discussion of asymptotic completeness, and |Vas 03j for a discussion of 
the proof of this estimate from a microlocal point of view. 



More standard escape function methods can prove related but weaker results. For example 
in |BGH10} Lemma 2.2], Burq, Guillarmou and Hassell use a positive commutator argument 
with a global escape function (see also |GeSj87 Appendix] for a more general version of the 
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same escape function) to prove local smoothing away from a trapped set. This corresponds 
in our setting to a resolvent estimate for ImA > Ch (i.e. not too close to the spectrum), and 
in this range of A one has more flexibility in the behavior of the escape function near infinity, 
because the resolvent has good mapping properties for a wider range of pairs of weighted 
spaces. This difference is most significant in the case of an asymptotically hyperbolic space, 
such as the hyperbolic cylinder of the example at the beginning of the introduction, because 
here it does not seem to be possible to modify the global escape function so as to give uniform 
estimates up to the spectrum. 



In Theorem 



1.3| the global construction is replaced by the 
assumption that u is 0{h^ x ) on F_ away from F. In the setting of resolvent estimates, this 
can be proved by commutator estimates on an asymptotically conic space (see [VaZw OOj . 
[Dat09j), but on more general spaces other methods may be more convenient, or even nec- 
essary. For instance, in |MSVllj . Melrose, Sa Barreto and the second author construct a 
parametrix for manifolds which are strongly asymptotically hyperbolic in a certain sense (see 
£6.2), and the Lagrangian structure of this parametrix implies the semiclassically outgoing 



property. In |VaslOl IVasllj , the second author proves the same result on more general even 
asymptotically hyperbolic spaces (in the sense of Q using commutator methods, but in 
order to do this he considers a conjugated operator on a modified space. 



The other advantage over global escape function methods is that, because our assumptions 
and constructions are completely microlocalized to a neighborhood of F (which may be a 
proper subset of the full trapped set), our method can give more precise information about 
a solution u to Pu = f in the case where different estimates on / are available on different 



parts of T*X. The key point is that in the Theorem 1.1 and in the example at the beginning 



of the introduction we apply Theorem 1.3 with T a proper subset of the trapped set. 



The structure of this paper is the following. In $2] we give definitions and notation. In $31 we 



1.3 



prove a special case of Theorem [L2] in which the ideas of the proof are more transparent. In 
we prove Theorem L3 In §[5]we prove Theorem LI and give an example in which Theorem 
can be applied to a subset of the trapped set which is not a connected component. In §[6 
discuss the semiclassically outgoing assumption and give examples of situations where it is 
satisfied, and we deduce Theorem 11.21 from Theorem 11.1 



wc 
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discussions about polynomially bounded resolvents, and also to Vesselin Petkov for several 
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supported weights. 



2. Definitions and notation 



• Let X be the interior of X, a compact manifold with boundary and let x be a 
boundary defining function on X, that is a function x G C°°(X; [0, oo)) with a; _1 (0) = 
dX and dx\ d x ^ 0. Let g be a Riemannian metric on X. We say that (X, g) is 
asymptotically conic (in the sense of the large end of a cone) if we have a product 
decomposition of X near dX of the form [0, e) x x dX where the metric g takes the 
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form 

dx 2 g 

9 = — + ~2> 

Or x z 

where g is a symmetric cotensor smooth up to dX with g\ox a metric. Such metrics 
are also sometimes called scattering metrics. 
If on the other hand 

dx 2 g 
3 = —^ + ^ 

where g is a symmetric cotensor smooth up to OX with g\ex a metric, and with g 
even in x, we say (X, g) is asymptotically hyperbolic. See |Gui05t Definition 1.2] for 
a more invariant way to phrase this definition. 
We denote by 7r the projection T*X — > X. 

If u is a function, ||w|| denotes the L 2 (X) norm. If A is an operator, \\A\\ denotes the 
L 2 (X) —7- L 2 (X) norm. Angle brackets (■, •) denote the inner product on L 2 (X). 
We say that a family of functions u = (uh)he(o,i) on X is polynomially bounded if 
\\u\\ < Ch~ N for some N . 

By u G 0(h°°) or u = 0(h°°) we mean \\u\\ < Cxh N for every iV and for h G (0, 1). 
By n > -0(h°°) we mean // > -C N h N for every N, h <E (0, 1). 
For a = (o A ) fte ( ,i) G C°°(T*X), we say a G 5 m ' fe (X) if a obeys 



< C a ^h- k (l + |C| 



2\(m-|/3|)/2 



in any coordinate patch, where the z are coordinates in the base and ( are coordinates 
in the fiber, and a, {3 are multiindices. Acting on u G C^°(X) compactly supported 
in a patch, Op (a) is a semiclassical quantization given in local coordinates by 

Op(a)«(z) = | e^/yz,C)u(CR. 

The operator Op(a) can be extended to general it G C^°(X) by using a partition 
of unity subordinate to an atlas of charts, and we say Op (a) G \l/ m ' fc (X). The 
quantization depends on the choice of atlas and on the partition of unity, but the 
classes S m ' k and ^) m > k do not. Moreover, for given A = Op (a) G \l/ m ' fc , the principal 
symbol, defined to be the equivalence class of a in S m,k / ' S 171 ^ 1 ^ 1 , is also invariantly 
defined. If A G ^> m > k and B G # m '' fc ', then [A, B] G an d has principal 

symbol jH a b. See, for example, [DiSj99, EvZwlOj for more information on these and 



other results from semiclassical analysis discussed in this section. 
By bicharacteristic we always mean a bicharacteristic of P, that is an integral curve 
of the Hamiltonian vector field of p (the principal symbol of P), contained in 
We denote by 7 P the bicharacteristic at p (or from p or through p), which is defined by 
the properties j'Jt) = H p (j p (t)) and 7 P (0) = p. We denote this by 7^ the restriction 
of 7 P to {±t > 0}. We call 7^ the forward bicharacteristic and 7" the backward 
bicharacteristic. 

For T d T*X invariant under the bicharacteristic flow, we define the forward, resp. 
backward flowout T + , resp. T_, of T as the set of points p G T*X from which the 
backward, resp. forward bicharacteristic segments tend to T, i.e. for any neighborhood 
O of T there exists T > such that —t > T, resp. t > T, implies 7 p (t) G O. Here we 
think of T as the trapped set or as part of the trapped, hence points in T_, resp. T + 
are backward, resp. forward, trapped, explaining the notation. 
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• For E C T*X, we denote by Tf the set {p G T± : 7J G P}. Note that E C F ^ 
r± C r±, and that r± \ is closed when U is open. 

• For k G K U {00}, we say that u is 0(h h ) at a point p G T*X if there exists 
a G C °°(T*X) with a(p) ^ such that || Op(a)u|| = 0(h k ). We say that u is 0(h k ) 
on a set E C T*X if it is 0(h k ) at each point in E. Observe that if E is compact 
we may sum finitely many such functions \a\ 2 to obtain b G Cq°(T*X) which is 
nonvanishing on E such that || Op(o)?i|| = 0(h k ). Observe also that the set on which 
u is 0(h k ) is open for any k. 

• The semiclassical wave front set, WF h (u), is defined for polynomially bounded u as 
follows: a point p G T*X is not in WFj,(ti) if u is 0(h°°) at p. One can also extend 
the definition to p G S*X (thought of as the cosphere bundle at fiber-infinity in 
T*X); then WF h (u) = implies u = 0(h°°) (in L 2 ). 

• The microsupport, WF' h A, is defined for A = Op(a) G ty m,k (X) as follows: a point 
p G T*X is not in WF'^A if |<9 a a| = 0(h°°) near p for any multiindex a. For any 
B G \l/ m ' k , we have WF' ft (L4, B]) C supp da, and for any u polynomially bounded we 
have WF/, Au C WF^ A n WF fe it. 

• If A G vl/™-'* 3 has principal symbol a = ah, we say that A (or a) is elliptic at a point 
p G T*X if |a(p')| > Ch~ k for p' near p and h > sufficiently small. We say A (or a) 
is elliptic on a set E (s T*X if it is elliptic at each point in E, and we automatically 
get a uniform estimate |a(p')| > Ch~ k for p' G E. Microlocal elliptic regularity states 
that if Au = f with u polynomically bounded, then if / is 0(1) on a set E and if A 
is elliptic on E, then u is 0(1) on E. 

• Let P G ^/ m '°(X) be a self adjoint, order m > 0, semiclassical pseudodifferential 
operator on X, with principal symbol p. For I C R compact and fixed, denote 
the characteristic set by S = p _1 (J), and suppose that the projection to the base, 
71 : S — > X, is proper (it is sufficient, for example, to have p classically elliptic). For 
w G C°°(T*X; [0,oo)). We say that a point p G £ is backward nontrapped with 
respect to p — iw, if either w;(7 P (t)) > for some t < or if for any (s T*X, there 
exists Tft- < such that 7 P (t) G" K whenever t < Tk- 

• We say that a polynomially bounded resolvent family Rh{X) is semiclassically out- 
going with loss of h~ x at backward nontrapped points if the following holds. If 
u = Rh(\)f with / compactly supported and p lies on a backward nontrapped 
bicharacteristic, and if / is 0(1) on the backward flowout of p, then u is 0(h~ l ) at 
p. In the rest of the paper we will often write simply 'semiclassically outgoing 7 for 
brevity, but note that this condition is stronger than the one in |DaVal0j because the 
loss is specified to be h~ x . This condition is discussed in 

• In this setting propagation of singularities states that if u = Rh(X)f, and u is 0{h k ) 
at p and / is 0{h k+l ) on 7 P ([0,T]) for some T > 0, then u is 0(h k ) at 7p (T). 



3. A MICROLOCAL PROOF IN A NON-MICROLOCAL SETTING 



In the next section we prove our general result. In this section we prove a special case 
of Theorem 1.2, indeed essentially a special case of |Bur02t (2.28)] and |CaVo02l (1.5)], in 
which the ideas are more transparent. We assume the resolvent is polynomially bounded 
and semiclassically outgoing at backward nontrapped points. However, we do not assume 
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a specific structure at infinity: this is replaced by the semiclassically outgoing assumption, 
which is currently known for certain asymptotically conic and hyperbolic infinities (see §[6]), 
but should hold in other cases as well. In this section we make a convexity assumption in an 
annular neighborhood of the trapped set, but this assumption is removed in the next section. 

Let X be a manifold without boundary, g a complete metric on X, and P a self-adjoint 
semiclassical Schrodinger operator on X. Assume that there exists a small family of convex 
compact hyper surf aces which enclose the trapped set in the following sense. Fix I C R 
compact and x G C°°(X) such that {x > 1} is compact and such that the trapped set V 
(i.e. the set of precompact bicharacteristics inp _1 (/)) sits inside {x > 5}. Suppose that the 
bicharacteristics 7 of P in p~ l (I) satisfy the convexity assumption 

1 < x(7(t)) < 5, x(7(t)) = x(7(t)) < 0. (3.1) 

Here we note that if / is a C°° function on [0, 00) with /' > 0, and x satisfies ( |3.1[ ) then so 
does fox. In particular the specific constants above and below (such as x < 5) are chosen 
only for convenience, and can be replaced by arbitrary constants that preserve the ordering. 
In examples x might be the reciprocal of a function which measures distance to a given point, 
or more generally x might be a boundary defining function. 



r 




+ 



Figure 2. The characteristic set X = p in §3| with bicharacteristics 



shown as arrows. The first paragraph of the proof of Proposition 3.1 reduces 
the problem to showing that u is (9(/i -1 ) on a compact subset of T + fl {3 < 
x < 4}. To do this we use as a commutator a cutoff function \ = x( x ) which 
is 1 for x > 4, for x < 3, and monotonic in between. This commutator has 
a uniform sign on the part of U- C {H. p x < —c} where x' is bounded away 
from 0. If supp x' is sufficiently large and c > is sufficiently small this set 
contains the compact subset of T + PI {3 < x < 4} in which we are interested. 

Proposition 3.1. Let (X,g), P, I, and x be as in the above paragraph. Assume that there 
exists N > 0, xo £ C^°(X) with xo = 1 on {x > 1}, and C > such that the resolvent 
satisfies 

||Xoi4(A)xo|| < Ch~ N , 
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for A G D C {Re A G /, ImA > — (9(/i°°)}. Assume that the resolvent is semiclassically 
outgoing at backward nontrapped points. Then if Xi £ C™{X) is supported in {3 < x < 4} 

||Xii4(A) Xl || <C7r\ 

/or X E D. 



Proof. We show first that if i> is compactly supported with \\v\\ = 0(1), and u = Rf l (X)f, 
where / = XiVi then u is Oih" 1 ) on T*suppxi- By our hypothesis, u is polynomially 
bounded in h, namely is 0(h~ N ), (Ph — X)uh = fh is 0(1) and compactly supported, and 
(Ph — X)uh = in x > 2. Thus, by microlocal elliptic regularity, using the polynomial 
bound, Uh is 0(1) away from the characteristic set, £ = {p — Re A G /}. Moreover, by the 
semiclassical outgoing assumption, if p is a point in X but not in r + , then (P — X)u = f 
being 0(1) implies that u is Oih' 1 ) along 7 P , i.e. a non-trapping estimate holds microlocally 
along 7 P . It remains to show that u is 0(h~ v ) on points in E fl T + fl {3 < rr < 4}. 

To do so, we proceed inductively, assuming that for some k < —3/2, u is 0(h k ) in a compact 
subset of {3 < x < 4}, and show that it is in fact 0(h k+1 ^ 2 ) on a slightly smaller subset. 
Note that the last assumption automatically holds with k < —N by the a priori polynomial 
bound assumption, and thus the proof of the proposition is complete once the inductive step 
is shown. 

Take x — x( x ) > to be a function such that x = 1 in ^ > 4, x = in a; < 3, and x is 
a increasing function of x, and x' — 4 )2 with ip smooth. By microlocal elliptic regularity, 
WFfc(w) fl suppx is a subset of the characteristic set of P h — A. Then consider 

( X u, {P - \)u) - ( X (P - \)u, u) = ([P, x]u, u) + (2t Im X X u, u). (3.2) 

The left hand side vanishes in view of the support properties of x an d f = (P — X)u. Since 
ImA > —0(h°°), i.e. for all M there is C such that ImA > —Ch M , we thus conclude that 

(i[P, X ]u,u)>-0(h°°). 

The semiclassical principal symbol of [P, y] is 

-hH P x = -hx'H p x. 

Letting c > to be determined later on, we now use a partition of unity for T*X correspond- 
ing to an open cover which in a neighborhood of the characteristic set over {3 < x < 4} is 
essentially given in terms of the sign of H p x. So consider a neighborhood of the character- 
istic set over {3 < x < 4} with compact closure K, and let O be a neighborhood of K with 
compact closure, and consider the open cover of T*X by 

U_ = {p G O : H p x(p) < -c}, U+ = {peO: H p x(p) > -2c} U (T*X \ K), 

and take <j>± G C°°(T*X) with <\>\ + 0^ = i an d sup p0 ± c S uppC/±. Then (-H p xfl 2 is C°° 
on supp 0_ , and 

H pX = -{{-H p xf/ 2 U-f + ij 2 H pX( pl, 
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so with b = (—HpxY^ipcj)-, e = ip 2 H p x(j) 2 +1 B,E E ^ °°' (X) with principal symbol b, resp. 
e, and microsupport supp b, resp. supp e. 

z[P, x] = —hB*B + hE + h 2 F, 

where F E ^-°°'°(X), so 

h\\Bu\\ 2 = ((hE + h 2 F -i[P, X ])u,u) = h(Eu,u) + h 2 (Fu,u) -2lm\\\x 1/2 u\\ 2 . 

Note that h 2 (Fu,u) is 0(h 2+2k ) by our a priori assumptions. Thus, if u is 0{h k+1 ^ 2 ) on 
WF' h (E) (half an order better than a priori expected), the same is true for u on the elliptic 
set of B, i.e. we have half an order improvement on the elliptic set of B. 

So far we worked with arbitrary c; however, if c is not suitably chosen, the assumption on 
u on WF' h (E) is not necessarily satisfied. Namely, we need to choose c so that WF' h (E) is 
in the union of the elliptic set with the backward non-trapped set, where we already have 
0(h~ l ) bounds on u. 

To do so we choose c > sufficiently small so that all bicharacteristics from points p in 
{3 < x < 4} with (H p x)(p) > —2c escape to x < 3 in the backward direction without 
entering the region x > 5. This is possible due to convexity and compactness: by convexity, 
if Hpx(p) > implies that on the backward bicharacteristic through p, x is decreasing as 
time decreases, so by compactness there exists T > such that if p is as above, then at 
time — T the bicharacteristics are in x < 2. Then by compactness again, there is c > 
such that for all p with (H p x)(p) > —2c, at time — T the bicharacteristics are in x < 2.5. 
With this choice of c, every point in WF' h (E) is backward non-trapped or elliptic. Thus, 
for k + 1/2 < —1, one deduces that u is 0(h k+l l 2 ) on the elliptic set of B. In particular, 
we conclude that where x' > 0, u is 0(h h+1 ^ 2 ) since such points are either in the elliptic 
set of B or of P — A, or (H p x)(p) > —2c there, and in either case u is 0(h~ l ) (here we use 
fc + l/2<-l). 

One can iterate this by shrinking the support of dx, hence those of B and E and deduce 
that u is actually Oiji" 1 ) in any compact subset of {3 < x < 4} (one has to choose the 
initial x appropriately if this subset is large). This proves that u is 0{h~ l ) on suppxi, 
i.e. \\xiRh(^)xi v II ^ Chr x . An application of Banach-Steinhaus finishes the proof, giving a 
constant C uniform in v. □ 



We remark that a key point in this argument is that because (P — X)u = in the trapping 
region, one needs to know nothing about u itself when one considers (x{P— A)w, u) — (xu, {P— 



X)u) in (3.2), at least if Im A > —0(h°°). If instead (P — X)u is 0(1) there, then all one can 
say is that u is 0{h~ N ) which completely destroys the bounds above, i.e. gives a loss. 

It is worth noting that although we needed ImA > —0(h°°), in any region ImA > —Ch s , 
s > 1, we can do a finite amount of iteration and improve on the assumption that u is 
0{h~ N ). However, it is not clear whether this can give any useful bounds in practice. 
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4. The general case 



In this section we prove Theorem 1.3 First observe that if u is 0(h~ l ) at a point p £ T + , 
then it is on 7+ the forward bicharacteristic from p. Hence it suffices to construct a 

microlocal commutant whose commutator is positive on points p such that 7" is contained in 
a small neighborhood of T, and merely nonnegative on the rest of r + . The main constraint 



on the neighborhood in which we work is that it must be contained in the U of Lemma 4.1 



and Remark 4J2 The proof uses an inductive iteration as in §|3j so in Lemma 4J3 we introduce 
open neighborhoods r C U\ <e Uq <£= U but no other properties of these neighborhoods will 
be used, and they may be arbitrarily close to V and to dU respectively. 

Lemma 4.1. Suppose LL is a neighborhood of (r_ \ T) fl (W \ V). There is a neighborhood 
UcVofT such that if a £ U \ T + then the backward bicharacteristic from a enters U- . 

Remark 4.2. Note that from this and from the assumption that u is 0(h~ r ) on T_, it follows 
that that u is on U\T + , provided U- is chosen sufficiently small, namely small enough 

that u is Oih^ 1 ) on £/_. Note also that, because U C V, we have WF ft / fl U = 0. 



Proof. Suppose no such U exists. Then there is a sequence a>j £ V \ T + such that a>j — >■ T 
but the backward bicharacteristics 7" through <x,- are disjoint from ?7_; by passing to a 
subsequence, using the compactness of T, we may assume that otj — > a £ T. By ( 1.4[ ), the 



bicharacteristics 7" enter \ V C W \ V, and the latter is compact. Let tj = sup{t < : 
latj{t) E an d let (3j = •y a .{tj), so /3j £ W \ V as the latter set is closed. Moreover, 

(3j £ V: indeed 7a ■([£/, 0]) is connected and contained in V U (T*X \ W 7 ), a union of disjoint 
closed sets, and 7^(0) £ V C V. By the compactness of V, the (3j have a convergent 
subsequence, say j3j k , converging to some (3 £ (W \ V) fl V = dV. 



We claim that (3 £ T_, which is a contradiction with /3j k ^ Z7_. Indeed, otherwise, by (1.4), 
the forward bicharacteristic 7^ from (3 intersects W \ V. Moreover, since 7/3(0) = (3 E V, 
there is T > such that 79 (T) £ W\V. Then, for sufficiently large fc, the same is true for the 
forward bicharacteristic at time T from (3j k as W^V" is open, i.e. 7 Qjfc (t, fc +T) £ By the 

definition of tj k , tj k + T > 0, so > — T for all fc. But, if 7 a is the bicharacteristic through 
a, then 7 aj (t) — > j a (t) uniformly in [— T, 0]. By passing to a convergent subsequence of tj k , 
say tj) , 7a., (tj> ) — >■ 7a(limt,' ) £ T by the flow-invariance of T, so (3 £ T which contradicts 

■* K 3 f- fa fa 

(3 ^ V. Thus, (3 £ T_, as claimed. □ 



In the following lemma we construct an escape function q £ C^°(T*X) which is constant 
near T, nonincreasing along T + , and has H p q < on a sufficiently large subset of T + . 
This construction is based in part on the construction of a nontrapping escape function in 
[VaZwOO, §4] and on the construction of an escape function away from a trapped set in 
|GeSj87[ Appendix]. We will use a quantization of q as a microlocal commutant in this 
section, replacing the cutoff function x of ^3] 
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Lemma 4.3. Let U\and Uq be an open set with T C U\ <s Uq <s U . Then there exists a 
nonnegative function q G Cq°(U) such that 



q = 1 near T, H p q < near F + , H p q < on r+° \ U 



Moreover, we can take q such that both y/q and ^—H p q are smooth near T + . 



Recall that is the set of points p G T + whose backward bicharacteristic 7 p is contained 
in E. The condition that yfq and ■u '—H p q are smooth near T + is used only to avoid invoking 
the sharp Garding inequality. 





\ Ui 


u ^ 












c 








1 


' i 







Figure 3. We construct q so that it is identically 1 near T, and then non- 
increasing along T + . We make q strictly decreasing along T^ \U\, and then 



identically outside of U (because in this last region Remark 4.2 provides no 
information about u so we must not produce any error terms here). Since q 
must be nonincreasing along T + and compactly supported, it must remain 
after this point, and in particular we cannot make H p q < on any of r + \ T^. 



To motivate the statement, we outline how Lemma [4.3| will be used to prove Theorem |1.3 
We will see that a positive commutator estimate as in §|3] directly gives us good control of 
u on \ Ui, where the commutator is elliptic, up to errors which are of two types. By 
propagation of singularities we can extend these good estimates to the forward flowout of 
\ U\, namely to Y + \U\. The first type of error is in the region away from T + , where 
we do not have H p q < 0, but here we know that u is 0(h~ 



4.2 



The 



thanks to Remark 

second type of error is in the region where H p q < but not uniformly bounded away from 
0. We control this error using an iteration as in §[3j We will need a finite sequence of qj (the 
number of iterations is determined by the polynomial bound on u) such that H p qj +1 < on 
supped H T + . To obtain qi we apply Lemma 4.3 with any U\, Uq satisfying the hypotheses 



of the lemma. To obtain qj +1 from qj we observe that 



T C T*X \ supp(l — qj) C suppgj C U, 
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and apply Lemma 4.3 with a new Ui, Uq such that U\ d= T*X\supp(l — qj) and supp qj C Uq. 
To simplify notation we will not discuss the iteration in more detail, and will simply use q 
rather than qj. 



Proof. We will construct a function q, smooth in a neighborhood of U, satisfying 

q = near T, H p q < 0, H p q\ rW ^ < 0, Q^W^ - _1 / 2 ' 9 - ~ 2 near r + \ r +- 

Then we take / G C°°(R) nondecreasing such that f(t) —t+1 near £ > —1/2 and /(£) = 
near t < —2. We take further \q £ C^°(U; [0, oo)) identically 1 near {g < 2} PI T + (note that 
{?< 2}nT + d [/). It then suffices to put 

q(p) = Xq(p)f(q(p))- 

Indeed, that q is nonnegative and identically 1 near T is immediate. That H p q < on r + °\Z7i 
follows from the fact that on that set we have / o q = q + 1 and x = 1 • That H p q < near 
T + follows from the fact that {H p q > 0} C suppdx q H {q < 2}, which is disjoint from T + . 

If / and Xq are chosen such that y/f and ^Jx~q are smooth, then ^fq is smooth. Meanwhile, 
near T + , —H p q = — (/' o q)H p q, and hence it suffices to make yfj 1 and ^J—H p q smooth. In 
the case of / it suffices to make / a translation of e —1// * |t>o near the boundary of its support. 
We will indicate below how to achieve this for q. 



We take q of the form 



N 

fe=l 



where each q Pk is supported near a portion of the bicharacteristic through p k , a suitably 
chosen point in r+° \Ui. 

To determine the pk we first fix open sets V\ and Vo with r C V\ (e U\ and Uq <e Vq (e U . 
We then associate to each p G r+° \ TJ\ the following escape times: 

T p Vl = inf{t G R : lp {t) G* Vi}, T p v ° ^ inf {t G R : 7p (t) £ V }, ^ = sup{t G R : 7p (t) G U}. 



Note that these are finite because of the definition of T + and (1.4). 

Next let S p be a hypersurface through p which is transversal to H p near p. Then if U p is a 
sufficiently small neighborhood of p, the set 

V p = { 7a (t) : a G C/ p n 5 P , t G (T p Vl - 1, T u p + 1)} 

is diffeomorphic to (S p fl f/ p ) x (T p Vl — l,T p + 1). We use this diffeomorphism to define 
product coordinates on V p . If necessary, shrink U p so that 

V p n{t <T p yi }nZ7^ = 0, ^n{£<T;»}cf/, T^n {t = T p v »} n Uo = 0. 

This is possible because 7p ({t < T p Vl }) n U[ = 0, 7p ({t < T p v °}) C Z7, and 7p (T p y °) £ ZTq- 
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Take <p p £ Cq°(S p fl U p ; [0, 1]) identically 1 near p, also considered as a function on V p via the 
product coordinates, and let V C V p be an open set containing 7p ([T p v ' 1 -1/2, T^ + l/2]) such 

that ip p = 1 on Vp. Observe that the V' with p £ r+° \ U\ are an open cover of T + fl Z7i, 

because any backward bicharacteristic from a point in r + fl U \ U\ enters r+° \U% eventually. 
Now take p%, . . . , pjy such that 

N 

r + nu\u 1 c\Jv p ' k . (4.2) 



k=l 



For each p £ {pi, . . . , p^} put 



9p = XpVp, H p q p = x'p^p 



where Xp G C°°((T^ - l,Tf + 1)). 



l 

2N 



TY 1 - 1/2 



P 



rpV 



















Xp 



Figure 4. The graph of x P , P e {pi, • • • ,Pjv}- 
We further impose that Xp has x' P (t) < for all t and also satisfies 

(1) x P (t) = for t < - 1/2, 

(2) x'it) < 0, X pW > -(2iV)- 1 for < t < TY°, 



(3) 



-2 for t > Tp° + e p . 



Here e p is a positive number less than 1/2 and small enough that 7«(t) £ £/ for a £ f/ p fl S p 
and t < + e p . Such an e p exists because V p n {t < T^ } C £7. Note that in condition (2) 
we use the same iV as in (4.2). Observe that extending q p by outside of V p gives a function 
which is C°° near £7. 



We now check that q has the desired properties. That q = near T follows from the fact that 
suppg C (J V Pk and each V pk is disjoint from T. That if p g < follows from x' p < 0. That 

H p q < and q > —1/2 on T u °\Ui follows from condition (2) on the xp an d from the covering 

property (4.2), as well as from the fact that we took care to make V p fl {t > T^ } fl r+° = 
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so none of the summands in (4.1) are too negative here. That q < —2 near T + \ follows 



from condition (3) on the xp together with (4.2). 



To make ^—H p q smooth, let ip{ s ) = for s < 0, ip(s) = e 1 / s for s > 0, and assume as we 
may that U p fl S p is a ball with respect to a Euclidean metric (in local coordinates near p) 



of radius r p > around p. We then choose cp p to behave like ip(r' — |.| ) with r' p < r p for |.| 
close to r' bounded away from for smaller values of |.|, and choose — x' p to vanish like ip at 
the boundary of its support. That sums of products of such functions have smooth square 
roots follows from |H594l Lemma 24.4.8]. □ 



We conclude this section and the proof of Theorem 1.3| by proving the inductive step in 
the iteration: if u is 0{h k ) on a sufficiently large compact subset of U fl T + \ T, then u is 
0(h k+1 l 2 ) on rf° \ U u provided k + 1/2 < -1. 

First let £/_ be an open neighborhood of T + fl supp q which is sufficiently small that H p q < 
on LL and that ^—H p q is smooth on [/_. Let U + be an open neighborhood of suppg \ C/_ 
whose closure is disjoint from T + and from T*X \ U . Define <f>± G C°°(U + U LL) with 
supp <f)± C U± and with <p 2 + + 0^ = 1 on U + U U- . 

Put 

b = <p-\/-H p q 2 , e = (j) 2 + H p q 2 . 

Let Q,B,E E 9~ oo,0 (X) have principal symbols q,b,e, and microsupports suppg, supp b, 
supp e, so that 

^[P,Q*Q] = -B*B + E + hF, 
with F E ^-°°'°(X) such that WF^ F C supp dq C U \ T. But 

U[P,Q*Q]u,u) = hm(Q*Q(P - X)u,u) + l(Q*QlmXu,u) > -O^M 2 , 
h h n 

where we used Im A > — C(/i°°) and suppg fl WF h (P — X)u = 0. So 

\\Bu\\ 2 < (Eu lU ) + h(Fu,u) + 0(h°°). 



But \{Eu,u)\ < Ch 2 because WF' A £ fl Y + = allows us to use Remark 4.2 to conclude 
that u is 0{h~ l ) on WF' h E. Meanwhile \(Fu,u)\ < C(hr 2 + h 2k ) because all points of 



WY' h F are either in U\T + , where we know u is 0(h x ) from Remark 4.2, or on a single 
compact subset of UnT + \T, where we know that u is 0{h k ) by inductive hypothesis. Since 
b = ^J—H p q 2 > on T^ \ U\, we can use microlocal elliptic regularity to conclude that u is 
0(h k+1 ' 2 ) on rj° \ U x , as desired. 

5. Application to resolvent estimates 

5.1. Proof of Theorem [Tl] Let / = Op(6)u, ||v|| = 0(1), u = R h (X)f. Let T be the union 
of the connected components of the trapped set which intersect the backward bicharacteristic 
flowout of supp a. Note that if V and W are chosen such that W is disjoint from any other 
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components of the trapped set, then the assumptions of Theorem |1.3| are satisfied. We must 



show that for any p G suppa, u is Oih x ) at p. There are three cases. 

(1) If p g" £ = p _1 (J), then u is 0(1) at p by elliptic regularity and the polynomial 
boundedness of the resolvent. 

(2) If p is backward nontrapped, then u is Oih^ 1 ) at p by the semiclassically outgoing 
assumption. 

(3) If p is backward trapped, then p G T + by the definition of T + and by the support 



property of a. Hence u is Oih x ) at p by Theorem 1.3 The assumption in Theo- 



rem 1.3 that u is 0(h 1 ) on T_ follows from case (2) above. 



This proves that 

||0p(a)i4(A) Op(6)u|| < C7T 1 . 
The uniformity in v follows from Banach-Steinhaus. 



5.2. Proof of Theorem 1.2, The estimate |CaVo02[ (1.5)] of Cardoso and Vodev reads, in 



the notation of Theorem |1. 2 

||< r )-V2-* (1 _ x){h 2 Ag _ E _ fe) -x (1 _ X )( r )-V^|| < Ch -i 7 (51) 

where x £ Cq°{X) is identically 1 on some (large) compact set. Meanwhile, from Theorem 
[l~I1(and using microlocal elliptic regularity) we have 

||X(1 - Op(a))(h 2 A g + V-E- ie)-\l - Op(o))x|| < Chr 1 , (5.2) 



for any \ G C^°(X) (see ^6.2| for a discussion of the semiclassically outgoing condition in this 
setting). If we take x to be identically 1 on a sufficiently large (compact) set, then we can 
apply the gluing method of |DaValO] to deduce (1.3) from (5.1) and (5.2). Since the proof 
below follows the proof of |DaValOl Theorem 2.1] closely we provide only an outline. 

After possibly multiplying the boundary defining function x by a large constant, we may 
assume suppl/ U suppx C {x > 4} and that if j(t) is a bicharacteristic of po = in 
p \E), then 

s( 7 (t)) = =}► x( 7 (t)) < 0, 
in {x > 4}. We now take x to be identically 1 near {x > 1}. Let xi e C°°(1R; [0, 1]) be such 
that xi — 1 near { x ^ 3}, and suppxi C {x > 2}, and let xo — 1 — Xi- Define a right 
parametrix for P = h 2 A g + V by 

F = X o(x - 1)(^ 2 A 9 - A)- 1 X o(x) + Xi (x + 1)(^A 9 + V - X)' 1 xi(x). 
We then put 

(P - A)F = Id +[P, X o(x - l)](h 2 A g - A)- 1 Xo (x) + [P, X i(x + l)}(h 2 A g + V - \)~ l xi(x) 
= ld+A + A v 
Now {DaValOt Lemma 3.1] implies that 

\\A A 1 \\ L 2^ L2 = O(h°°), 
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so that, using Aq = A\ = 

(P - X)(F - FA - FA X + FA 1 A ) = Id -A A 1 + A Q A 1 A . 

Note that the remainder is trivial in the sense that ||AoAl|| + ||v4ov4 1 v4o(r)~ 1 / 2 ~ <5 || < 0(h°°). 
Since (5.1) and ( |5.2 ) imply that 



_ 0p (a))(F - FA Q - FA l + FA 1 A )(1 - V (a))(r)- l ' 2 - 8 \\ < d/T 1 , 
this completes the proof. 

5.3. Nontrapping estimates on part of the trapped set. We now give an example, 



although a somewhat unphysical one, in which Theorem 1.3 can be applied with V a proper 



subset of the trapped set but not a connected component. In this example we obtain the 



nontrapping estimate ( 1.1 ) for a and b with supports overlapping a certain part of the trapped 



set. More specifically, we will apply Theorem L3 with V a union of closed orbits and with 
part of T + or T_ contained in the trapped set. 

Let y = y(z) G C°°(M) be even, positive- valued, with a nondegenerate local maximum at 0, 
and with y" > outside of a neighborhood of 0, such that y" changes sign only twice. Let 
(X, g) be the surface of revolution obtained by revolving the graph of y around the z axis 
(see Figure [5]). Suppose this surface is an asymptotically conic or hyperbolic manifold as in 
^2] (for example, it may be a catenoid outside of a compact set). We will use coordinates 
(s, 9) on X, where s = s(z) is an arclength parametrization of the graph of y with s(0) = 0, 
and 9 measures the angle of revolution. Let a(s) = y{z) and (cr, /i) be dual to (s, 9). In these 
coordinates the manifold (X, g) and the geodesic Hamiltonian po are given by 

X = R s x (M/27rZ) e , g = ds 2 + a(s) 2 d9 2 , p = a 2 + a(s)"V- 

Let So be the point in {s > 0} at which the global minimum of a is attained. The unit speed 
geodesic flow has six closed orbits along latitude circles: two elliptic orbits at s = and 
two hyperbolic orbits at each of s = ±so- See Figure [5] for a sketch of the projection of the 
bicharacteristic flowlines to the (s, cr) plane. 



We would like to apply Theorem 1.3 with T taken to be one or several of the hyperbolic 
closed orbits at s = ±sq. However, the resolvent of the Laplacian on this surface will not 
be polynomially bounded because of the elliptic trapping, and T_ in this case will include 
trapped trajectories on which (^(h^ 1 ) resolvent bounds do not hold, so we introduce a com- 
plex absorbing barrier as in 



be supported as in Figure 5 



:6.1 to suppress some of the trapping. Let w G C^(T*X; [0, 1]) 
and satisfy w = 1 on S*X fl {s = 0, cr < 0}. More specif- 
ically, we require that supply C {— s /2 < s < s /2}, and that supply be disjoint from 
bicharacteristics j(t) with lim^-too s(7(t)) = ±s . Let 



P = h 2 A g - 1 - iW, 



where W G \& _oo ' (X) has principal symbol w. In Lemma 5.1 we show that the resolvent 
of this operator is polynomially bounded. The proof uses microlocal estimates near the 
hyperbolic orbits originally due to Christianson |Chr07t IChr08| together with the gluing 
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Figure 5. The surface of revolution (X, g) with its three geodesic latitude 
circles, and the unit speed geodesic flow on S*X projected onto the (s, cr) 
plane. The complex absorbing barrier w is supported inside the dashed outline. 



In Proposition 5J2 we apply Theorem L3 first with T taken to be the two 
hyperbolic closed orbits at (s, a) = (— so, 0), and then with T taken to be the 
orbits at (s, a) = (so, 0). The darkened arrow is the portion of the trapped set 
on which we prove a nontrapping resolvent estimate. 



method of |DaValO| . To apply the gluing method, we use the following convexity properties 
of the bicharacteristic flow: If 7 (t) is a bicharacteristic in S*X, then 



s(j(t)) = 0, ±s(j(t)) >s ±s(rf(t)) > 0, 

s( 7 (*)) = 0, < ±s(7(*)) < s => ±Hl(t)) < 0. 
Lemma 5.1. For all xo £ Co°(^) there exist C, ho such that 

log 2 (l//i) 



||Xo(^- A)- 1 X o|| < C 
for < h < ho and Re A = 0, Im A > 0. 



h 



(5.3) 
(5.4) 



(5.5) 



It is natural to conjecture that log 2 (l//i) could be improved to log(l//i) in (5.5). This is the 
(optimal) bound obtained in |Chr07t IChr08t INoZw09i IWuZwlO] in various settings where 
there is hyperbolic trapping. For example if one had the analogue of |BuZw04l Theorem A] 
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or |Chr07t (1.6)] for the model operator P\ in the proof below, the parametrix construction 
would give this bound 



Proof. We define two model operators: a nontrapping model Pq and a trapping model Pi. 
Unlike in the usual setup, the nontrapping model is "compact" in the sense that it agrees 
with P only for small values of s, while the region near {|s| > sq} is suppressed by a complex 
absorbing barrier. Meanwhile the trapping model is "noncompact" in the sense that it agrees 
with P outside a small neighborhood of {\s\ = 0}, and only the region near {\s\ = 0} is 
suppressed. For the resolvent of Pq we prove an 0(h~ l ) bound (this is standard), and for the 
resolvent of Pi we prove an Oih~ x log(/i -1 )) bound (for this we use [DaValOt Theorem 2.1]), 
after which an 0{hr x log 2 (/?, _1 )) bound for P follows by a slightly more complicated version 
of the parametrix construction of |DaVal0l §3]. 

More concretely, let W E C°°(X; [0,1]) be for \s\ < 5s /7 and 1 for \s\ > Qs /7. Let 
Wi G C°°{X; [0, 1]) be for \s\ > 2s /7 and 1 for |s| < s /7. 




s o \s 



Figure 6. The complex absorbing barriers and cutoffs of Lemma 5.1 



Then put 



def 



def 



Xj = X \ supp Wj, 



and let Rj{\) = (Pj — A) 1 . By the discussion in £6.1 



Pi\x* = P\ 
we have 



x 



je{0,i}, 



||Xoi2o(A)xo|| <Ch-\ 

because all backward bicharacteristics enter {Wq = 1}. Meanwhile the trapping in Pi consists 
of four isolated closed hyperbolic orbits, and hence 



||Xo^(A)xo|| < C 



log(Vfe) 
h ■ 



by |DaVal0l Theorem 2.1], where we used the convexity conditions (5.3) and (5.4) to glue 
a trapping estimate near the hyperbolic orbits (such as [WuZwlOl (1.1)]) to a nontrapping 
estimate for the infinite end (such as |CPV04l (1.6)]). Note that by the discussion in §[6j the 
resolvents of both P and Pi are semiclassically outgoing. Now let Xo £ C°°(IR; [0, 1]) be 1 
near \s\ < 3s /7 and near \s\ > 4s /7, let xi — 1 — Xo> an d define a right parametrix for 
Pby 



def - 



Xo(s - s /7)R (X)xo(s) + Xi(s + s /7)Pi(A)xi(s) 



An iterated construction using this P, as in |DaVal0t §3] (or as in £ |5.2| above), gives (5.5). 
More specifically, put 

(P - A)P = Id + [P, xo(s - s /7)]R (X)Us) + [P, Us + s Q /7)]P 1 (A)x 1 ( S ) 
= ld+A + Ai. 
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Although we have Aq = A\ = as before, ||AoAi|| 7^ 0(/i°°) because there are bicharacter- 
istics which pass from suppxi to suppc?x 1 (s + s /7) to suppxo( s — s o/7)- We accordingly 
iterate the parametrix three more times, writing 

(P - A)F(Id -A -A 1 + A X A Q + A A X - A Q A X A Q - A^AqAJ 

= Id -AxA AiA - A AiA Ai, 

The remainder is trivial in the sense that 

\\AiAoAiAoXoW + PoAA^iH = 0(h°°), 
and our parametric obeys the estimate 

M 2 (l/h) 



\\XoF{Id -Ao -A x + A 1 A + A A 1 - A^Aq - A 1 A A 1 ) X o\\ < C- 



h 



completing the proof of (5.5). □ 



Now by the discussion in £J6]the resolvent (P — A) -1 is semiclassically outgoing, and recall that 
trajectories which intersect {w = 1} at some negative time are considered backward non- 
trapped, allowing us to apply Theorem 1 with T taken to be one or several of the hyperbolic 
closed orbits at s = ±So- For example, we have the following statement: 

Proposition 5.2. For all %\ £ C^(X) with suppxi fl {\s\ = s } = 0, there exist C, h such 
that 

\\ Xl (p - xy^W < ( l 

forO<h<h and Re A = 0, Im A > 0. 



Proof. We closely follow £5.1. Let / = Xi v i 



that for any p £ T* suppxi, u is 0(h ) at p. 



\v\\ = 0(1), u = (P — 
There are four cases. 



A) 1 / '. We must show 



(1) If p ^ E = p _1 (0), then u is 0(1) at p by elliptic regularity and the polynomial 
boundedness of the resolvent. 

(2) If p is backward nontrapped (i.e. either escapes to infinity or enters the interior of 
the support of w), then, because (X, g) is asy mptotically conic or hyperbolic, u is 
0(/i _1 ) at p by the discussion in £6.1 and £6.2 

(3) If linii_ s ._ 00 s(y p (t)) = —so, then u is 0{h~ l ) at p by Theorem 1.3 applied with Y the 
union of the two closed orbits at s — —sq. The assumption in Theorem [O that u is 
0(h~ l ) on T_ follows from case (2) above. 

(4) If lhm._5._00 s(y p (t)) = So, then u is 0{h~ l ) at p by Theorem 1.3 applied with T the 
union of the two closed orbits at s — Sq. The assumption in Theorem 1.3 that u is 
0(/i _1 ) on T_ follows from cases (2) and (3) above. 



This proves that 

\\xi{p - ^r\iv\\ <ci, 

The uniformity in v follows from Banach-Steinhaus. 



-1 



□ 
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6. Semiclassically OUTGOING RESOLVENTS 



In this section we discuss the assumption that the resolvent family is semiclassically outgoing. 
As mentioned above, this condition replaces any explicit assumptions about the structure of 
the manifold near infinity and allows us to work in an arbitrarily small neighborhood of the 
trapped set. In ^61 we explain this condition in the case of a polynomially bounded resolvent 
with a complex absorbing barrier added, a convenient simple model of infinity used to study 
resolvents in trapping geometries. In £(^2 we consider manifolds which are asymptotically 
conic or asymptotically hyperbolic in the sense of §[2] Finally, in ££^3 we give an example 
from 3-body scattering, illustrating that this assumption is flexible in the sense that it can 
hold on a manifold whose natural compactification is a manifold with corners rather than 
a manifold with boundary, and which is not covered by the analysis of |CaVo02[ ICPV04] . 
Introducing a suitable short-range three-particle interaction in this setting can produce a 
hyperbolic trapped set to which Theorem |1 .3 can be applied. 



In all the examples discussed in this section, the semiclassically outgoing condition with a 
quantified h~ l loss follows from the proof of the same condition without the quantified loss. 
This weaker condition is discussed in |DaValO] for several of the examples below, and since 
no significant changes are needed we omit many details. 



6.1. Complex absorbing barriers. The simplest setting in which the resolvent is semi- 
classically outgoing is when "infinity is suppressed" by a complex absorbing barrier, which 
we denote by adding a term of the form —iW to a Schrodinger operator. See |NoZw0 9] and 
[WuZwlO] for examples of theorems about resolvent estimates in the presence of trapping 
which are simplified in this setting, and see [DaValOj for a general method for gluing in 
another (more interesting) semiclassically outgoing infinity once such an estimate is proved. 
This method is used in the present paper to construct the example in £j5} 

The following lemma is standard, and the proof is essentially the same as that of |DaValOl 
Lemma 5.1]. 

Lemma 6.1. Let {X,g) be a complete Riemannian manifold, let Pq = h 2 A g + V be a 
semiclassical Schrodinger operator with V G C°°(X), let P = P — iW where W = Op(io) 
and w G C°°(T*X; [0, 1]) is identically 1 off a compact subset of T*X, and let I C R be 

compact. Suppose Rh{X) = (P — A) -1 , is polynomially bounded for A G D C {Re A G 
/, ImA > —0(h°°)}. Then -Rh(A) is semiclassically outgoing for A G D. 



In applications, w is often chosen to be identically near T, and the assumption on w is 
often replaced by the assumption that w G C°°(X; [0, 1]) with w identically 1 off a compact 
subset of X. 



6.2. Asymptotically conic and hyperbolic manifolds. On an asymptotically conic 
manifold (see ^2] for a definition), the semiclassically outgoing assumption follows from the 
construction and estimates of |VaZw00j : see |Dat09l Lemma 2] for a very similar statement. 
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On an even asymptotically hyperbolic manifold (see ^2] for a definition) the semiclassically 
outgoing property is proved in |VaslOt Theorem 4.3] (see also |Vasllt Theorem 5.1]). 

Another approach is possible in the case when (X, g) is asymptotically hyperbolic and sat- 
isfies the additional assumptions that each connected component of OX is a sphere and 
that 

9 = 9m + g, 

where ge is a symmetric cotensor which agrees with the hyperbolic metric on HP in a neigh- 
borhood of each connected component dX, and g is a symmetric cotensor smooth up to dX. 
Namely, one can use an argument similar to that in |DaValOl §4.2] and derive the semiclas- 
sically outgoing property from a description given in [ MSVllj of the Schwartz kernel of the 
resolvent as a paired Lagrangian distribution, to which a semiclassical version of |GrUh90 
Theorem 3.3] can be applied. 

6.3. An example from 3-body scattering. Consider the following 3-body Hamiltonian 

on 1R 3 : 

P = ~h 2 d 2 xi - h 2 d 2 X2 - h 2 2 X3 + V(xi - x 2 ) + V{x 2 - x 3 ) + V(x 3 - x x ) - 1, 

where V G C£°(R). The particles here are constrained to move on a line, and V is the 
interaction potential between each pair of them. Passing to center of mass coordinates, we 
obtain the following reduced Hamiltonian on the plane X = {xi + x 2 + £3 = 0}: 

P = -h 2 A + it\V + 7T* 2 V + 7T* 3 V - 1, 

where Hi is the projection (xi,x 2 ,x 3 ) h->- x\ — x 2 , and similarly for tt 2 and 7r 3 . Note that 
even when V is small, the perturbation is very long range (and consequently not covered by 
[CaVo02[ ICPV04] ) . and it cannot be extended smoothly to a compactification X of X unless 
X is a manifold with corners. 

In |Ger90] , Gerard shows that if V is classically nontrapping (for example it suffices to take 
V small) then the resolvent obeys the standard nontrapping bound: 

WxRhWxW < Ch~\ 

for < h < h , |ReA| < Eq < 1, ImA > 0. Moreover the methods of the paper, more 
explicitly elaborated by Wang |Wan91j in the general X-body setting, imply that the re- 
solvent is semiclassically outgoing |W an91l (1.8)]. More specifically, Wang shows that for / 
compactly supported, Rh{X)f is 0(h°°) near spatial infinity, where the radial momentum is 
negative. If V is nontrapping, any backward bicharacteristic eventually enters this region, 
so the semiclassically outgoing condition follows from propagation of singularities. 
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